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* Parallelization support Tools 

- CAPTools: Transforms serial Fortran code into MPI code 
with user guidance 

- CAPO: Transforms serial Fortran code into OpenMP code 
with user guidance 

- Charon: library tool for data distribution and message 
passing on lop of MPI. 

- Adapt: tool for data placement in data parallel 
programming models 

- Current work: support of multi-level parallelization and 
hybrid MPI-OpenMP parallelization 


NAS Parallel Tools Group (2) 
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• P2d2 parallel/distributed debugger 

• Evaluation of various parallelization strategies: 

- performance, type of application, type of hardware 
architecture, portability 

• Distributed and aggregated computing: 

- large applications running under Globus 

• Jobs scheduling and resource allocation under 
Globus 
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M Historical Background 


•^-Goal tn~H)94; Develop a 
distributed debugger 

- with a user interface that 
scales to "many” 
processes 

- portable across a large 
variety of machines 

Result in 1996: p2d2 
(portable parallel/ 
distributed debugger) 

- scalable Ul 

- highly portable 

- facilitates further 
research 



Debugging Challenge 1998 

^ Ne e d a d ebugger for computational grids 



• Rest of talk: 

- Debugger are hi lecture 

* support of heterogeneity 

* support of scalability 

- Attaching to grid computations 

- Quick discourse on running jobs under Globus 


/fi Debugger Dependencies 

•^Functiofo of the Debugger: 

- Mapping between user view of a program at source code 
level onto the machine version at object level. 

• Dependencies: 

- Target architecture * Breakpoint implementation 

- Operating system * Process control 

— Compiler ► Symbol table information 

Additional dependencies for parallel processing, e.g : 

- thread abstraction, 

- synchronization method, 

- message passing format, 

- process creation 








M Accomodating Heterogeneity 1 
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*»" P2d2 approach to heterogeneity: 

- Isolate the dependencies of the debugger from the user interface through the 
use of a client-server model. 

• Debugger server : 

- Architecture-, OS-, and compiler-dependent code. 

- Implemented by vendor. 

♦ User interface (UI) client: 

- portable code 


Initial Implementation 



V \jse $dA from the Free Software Foundation as debugger server 

- Advantages: 

* freely available 

■ portable 

- Disadvantages: 

■ Fortran support minimal 

• Replication of gdb's permits heterogeneity. 
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Scalability 




“Main debugger operations that need to scale: 

- process control operations 

• setting^deleting breakpoints, continue, single step 

- stale examination 

• print, display, stack trace 
Debugging N processes: 

- indicate on which processes control operations are performed 

- extract state information across a set of processes 
p2d2 process navigation paradigm: 

- process control operations to processes in control set m 

- overview of global state in process grid 

- more information about processes in focus group 

- detailed information about focus process. 


Scaling th e User Interface w 


Allow collective control of processes 

Provide “zooming" with 3 levels of detail for siaae examination. 



The Process Grid: 



• Overview of all processes in the computation 

* Used for "zooming in" on processes for closer examination: 

- the focus group 

* one line of text about each process in group 

- the focus process: 

• detailed information about a single process 

- the control set: 

* processes that receive control operations (break pts, continue) 

• indicated by white frame, selected by mouse click 
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jA Brief Discourse on Globus (1) ( 


* What are Grids? 

- Super Internets for high-performance computing 
— Worldwide collection of high-end resources: 

■ supercomputers, storage, advanced instruments, immersive environments 

- Enable the development of applications that require geographically 
distributed high end resources 

* What is Globus? 

- Software toolkit to facilitate the creation of Grids 

- Allows: 

* uniform access to distributed resources 

* information services about available resources 

* tool s for remote Iile management, staging of executables and data 






Process grid view can be programmed: 

* a list of directives of the form: <icon> if <predicate> 

Samples for <predicate>: 

■ nmningf), eval(expr). systemMaiches (string) 
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Heterogeneity & the UI-Abstract Data View 


Distributed array view 


Globa! Array View 


Local Array View 


- - Comparing expression values across processes: 

• gdb evaluates to text 

" question: In what context should gdb do the evaluation? 

- P2d2 tries to do evaluation in equivalent stack frame: 


tl In totoO 


Process 2; 

90 In sub3{) 

91 in Bub3 {) 


93 in Hint) 

In heterogeneous environment: 

• function names don’t match, e g., 

toto vs. toto_ vs. toto 

convert function names to canonical form 


Status and Future Work 


Status of p2d2 debugging Globus jobs: 

- debugged a Globus job running on 3 machines 

• SGI Origin in California 

• PC /Linux in Ohio 

• Sun Sparc Workstation in Virgina 

- debugged a 128-process Globus job running on 3 Origins 

- not yet there : 

• record contact information in Mils 

• security for Globus initialed jobs 

Distribution Status: 

- plan to distribute under an “OpenSource" copyright 

Current work: 

- relative debugging of tool-parallelized programs 






